Replication Schemes to Support Failure Resilient Processing of Real Time Data Streams
نویسندگان
چکیده
In this paper we explore the use of replication for fault tolerant processing of streams. We perform these experiments in the context of the Granules stream processing system that is designed for real time processing of data streams generated by devices and instruments. In this paper we explore well-known replication schemes for fault tolerant processing of data streams. We analyze two basic approaches to replication: active and passive; within the context of the Granules cloud runtime. As a proof of concept, we work with a medical dataset from a patient monitoring system that keeps track of patient
منابع مشابه
Failure-resilient real-time processing of health streams
The ability to analyze streaming data in real-time is vital in systems that process data from health sensors. These systems need to build and maintain state, as well as preserve this state in the face of system failures. In this work, we introduce a fault-tolerance scheme designed for the Granules stream processing system. We work with two distinct health stream datasets: thorax extension and e...
متن کاملDiscretized Streams: A Fault-Tolerant Model for Scalable Stream Processing
Many “big data” applications need to act on data arriving in real time. However, current programming models for distributed stream processing are relatively low-level, often leaving the user to worry about consistency of state across the system and fault recovery. Furthermore, the models that provide fault recovery do so in an expensive manner, requiring either hot replication or long recovery ...
متن کاملFPGA Implementation of JPEG and JPEG2000-Based Dynamic Partial Reconfiguration on SOC for Remote Sensing Satellite On-Board Processing
This paper presents the design procedure and implementation results of a proposed hardware which performs different satellite Image compressions using FPGA Xilinx board. First, the method is described and then VHDL code is written and synthesized by ISE software of Xilinx Company. The results show that it is easy and useful to design, develop and implement the hardware image compressor using ne...
متن کاملارائه روشی پویا جهت پاسخ به پرس‌وجوهای پیوسته تجمّعی اقتضایی
Data Streams are infinite, fast, time-stamp data elements which are received explosively. Generally, these elements need to be processed in an online, real-time way. So, algorithms to process data streams and answer queries on these streams are mostly one-pass. The execution of such algorithms has some challenges such as memory limitation, scheduling, and accuracy of answers. They will be more ...
متن کاملMonitoring the censored lognormal reliability data in a three-stage process using AFT model
Improving the product reliability is the main concern in both manufacturing and service processes which is obtained by monitoring the reliability-related quality characteristics. Nowadays, products or services are the result of processes with dependent stages referred to as multistage processes. In these processes, the quality characteristic in each stage is affected by the quality characterist...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2011